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(54) Method of enhancing the resolution of a display system 



(57) A display system (20) that uses multiple SLMs 
(25) to enhance horizontal or vertical resolution, or both. 
For example, to approximate a two-fold increase in hor- 
izontal resolution, the input data is sampled at a doubled 
rate, and each SLM (25) receives every other sample. 
Each SLM (25) generates an image, and the two images 



are partially superposed with a horizontal offset and 
simultaneously displayed. The resulting output image 
has a perceived resolution that approximates that of an 
image generated by an SLM with twice as many pixels 
per row. 
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Description 

TECHNICAL FIELD OF THE INVENTION 

This invention relates to spatial light modulators, and 
more particularly to a method of using multiple spatial 
light modulators in an image display system to enhance 
resolution. 

BACKGROUND OF THE INVENTION 

Spatial light modulators (SLMs) are commonly used 
for image display applications. In general, an SLM is an 
array of Individually addressable pixels. Many SLMs are 
binary, having an address scheme that switches the pix- 
els to either to an "on" or an "off' state to form the image. 
Various modulation and integration schemes are used to 
provide greyscale images. 

One type of SLM is a digital micro-mirror device 
(DMD), sometimes referred to as a deformable mirror 
device. The DMD has an array of hundreds or thousands 
of tiny tilting mirrors, which are the pixels. To permit the 
mirrors to tilt, each is attached to one or more hinges 
mounted on support posts, and spaced by means of an 
air gap over underlying control circuitry. The control cir- 
cuitry provides electrostatic forces, which cause each 
mirror to selectively tilt. For display applications, image 
data is loaded to the DMD, and in accordance with the 
data, light is selectively reflected or not reflected from 
each mirror to an image plane. 

For display systems that are based on SLMs, a con- 
ventional method for increasing resolution of the image 
is to increase the number of pixels in the SLM array 
Thus, for increased horizontal resolution, more samples 
of data per row are generated and an SLM having more 
pixels per row is used. For increased vertical resolution, 
more rows of data are generated and an SLM having 
more rows per image is used. A drawback of this 
approach is that the SLM is more complex, and therefore 
more expensive. Also, unless the size of the pixels of the 
SLM is adjusted, an increase in the number of pixels per 
row without the proportionate increase in the number of 
rows, or vice versa, will alter the aspect ratio of the output 
image. 

SUMMARY OF THE INVENTION 

One aspect of the invention is a method of enhanc- 
ing the resolution of adisplay system, the display system 
including two or more spatial light modulators (SLMs), 
which method comprising, receiving sampled image 
data for each spatial light modulator, focussing radiant 
energy reflected from each spatial light modulator to form 
a sub-image on an image plane, each spatial light mod- 
ulator generating the sub-image such that it is at least 
partially superposed with an offset with respect to the 
sub-images of each other spatial light modulator, and 
simultaneously displaying the sub-images from each 
spatial light modulator. 



An advantage of the invention is that it uses the 
same SLMs as are used for display systems with lesser 
resolution, and achieves the enhanced resolution by 
merely increasing the number of SLMs per system. Also, 
5 the invention permits the use of square pixels for enhanc- 
ing resolution, but without affecting the aspect ratio of the 
image. 

The invention also extends to a display system com- 
prising, two or more spatial light modulators (SLMs) each 

10 spatial light modulator being arranged to receive sam- 
pled image data, focussing means for focussing radiant 
energy reflected from each spatial light modulator to form 
a sub-image at an image plane, each spatial light mod- 
ulator generating the sub-image such that it is at least 

15 partially superposed with an offset with respect to the 
sub-images of each other spatial light modulator, and 
display means for simultaneously displaying the sub- 
images from each spatial light modulator. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates one pixel element of a digital 
micro-mirror device (DMD), suitable for use in a 
DMD array in accordance with the invention; 

25 

Figures 2 and 3 each illustrate an SLM-based dis- 
play system in accordance with the invention; 

Figure 4A illustrates a portion of the partially super- 
30 posed images generated by the DMDs of Figure 2 
or Figure 3, which has enhanced horizontal resolu- 
tion in accordance with the invention; 

Figure 4B illustrates a portion of a partially super- 
35 posed image generated by two DMDs in a system 
similar to that of Figure 2 or Figure 3, which has 
enhanced vertical resolution in accordance with the 
invention; and 

40 Figures 5 - 8 illustrate the perceived quality of 
images generated in accordance with the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

45 For purpose of example, the following description is 
in terms of display systems whose spatial light modula- 
tors (SLMs) are digital micro-mirror devices (DMDs). 
However, the same concepts apply to display systems 
that use other types of SLMs. For example, a display sys- 

so tern having an array of liquid crystal pixels instead of a 
DMD array could be devised with appropriate modifica- 
tions to the systems described below. 

In general, the invention provides a display system 
with enhanced resolution, by merely increasing the 

55 number of SLMs. Either horizontal or vertical resolution, 
or both, can be enhanced. For example, to approximate 
a two-fold increase in horizontal resolution, the system 
uses two SLMs, each having x pixels per row and y rows. 
Each of the two SLMs provides a "sub-image", generated 
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from alternating samples of data, with the sampling rate 
providing 2(x) samples per row. The two images are par- 
tially superposed, with a horizontal offset of 1/2 the 
center-to-center horizontal spacing of the pixels of the 
SLM. The resulting image has a perceived quality 5 
approaching that of a system that generates a single 
image from an SLM having 2(x) pixels per row. 

DMD Overview 

Figure 1 is an exploded perspective view of a single 
mirror element 10 of a DMD array. As explained below, 
to implement the invention, DM D-based display systems 
have multiple arrays of mirror elements 10. In a typical 
DMD array, each mirror element 10 is about 16 microns 
square, and the center-to-center spacing of mirror ele- 
ments 10 is about 1 7 microns. 

For purposes of example, mirror element 1 0 is a hid- 
den-hinge type mirror element. As with other DMD 
designs, mirror element 10 has at least one hinge 12. 
Hinge 12 is supported between hinge support posts 13. 
Address electrodes 14 are supported by electrode sup- 
port posts 15 on the same level as hinges 12 and hinge 
support posts 13. Mirror 1 1 is fabricated above the level 
of hinge 1 2 and electrodes 1 4 and is supported by mirror 
support post 16. 

Mirror support post 16 is fabricated over a landing 
yoke 17, which is attached to hinge 12. The hinge sup- 
port posts 1 3 and electrode support posts 1 5 support the 
hinges 12, address electrodes 14, and landing yoke 17 
over a control bus 1 8 and electrode pads 1 9. When mirror 
1 1 is tilted, the tip of the landing yoke 1 7 contacts control 
bus 18. The control bus 18 and landing pads 19 have 
appropriate electrical contacts with a substrate of 
address and control circuitry, which is typically fabricated 
using CMOS fabrication techniques. 

Another type of mirror element that can be used in 
DMD arrays in accordance with the invention is the tor- 
sion beam type, whose hinges extend from opposing 
sides of the mirror, rather than being under the mirror. 
Other types of suitable mirror elements are cantilever 
beam types and flexure beam types. Various DMD types 
are described in U.S. Patent No. 4,662,746, entitled 
"Spatial Light Modulator and Method"; U.S. Patent No. 
4,956,619, entitled "Spatial Light Modulator"; European 
Patent No. 0,332,953; Published European Patent Appli- 
cation No. 0.469.293A2 and Published European Patent 
Application No. 0,664,470 A2. Each of these patents is 
assigned to Texas Instruments Incorporated. 

In operation, voltages based on data in the memory 
cells of the underlying CMOS circuit are applied to the 
two address electrodes 14, which are located under 
opposing corners of mirror 11. Electrostatic forces 
between each minor 11 and its address electrodes 14 
are produced by selective application of voltages to the 
address electrodes 14. The electrostatic force causes 
each mirror 11 to tilt either about +10 degrees (on) or 
about -10 degrees (off), thereby modulating the light inci- 
dent on the surface of the DMD. Light reflected from the 



4 

"on" mirrors 1 1 is directed to an image plane. Light from 
the "off" mirrors 1 1 is reflected away from the image 
plane. The resulting pattern forms an image. 

In effect, the mirror 1 1 and its address electrodes 14 
form capacitors. When appropriate voltages are applied 
to a mirror 1 1 and its address electrodes 14, a resulting 
electrostatic force (attracting or repelling) causes the 
mirror 11 to tilt toward the attracting address electrode 
14 or away from the repelling address electrode 14. The 
mirror 1 1 tilts until yoke 17 contacts bus 18. 

Once the electrostatic force between the address 
electrodes 14 and the mirror 1 1 is removed, the energy 
stored in the hinge 12 provides a restoring force to return 
the mirror 1 1 to an undef lected position. Appropriate volt- 
ages may be applied to the mirror 1 1 or address elec- 
trodes 14 to aid in returning the mirror 11 to its 
undetected position. 

Display Systems 

Figures 2 and 3 illustrate DMD-based display sys- 
tems 20 and 30, respectively, each having two DMDs 25. 
Figure 2 illustrates a display system 20, which receives 
an analog video signal such as a television broadcast 
signal. Figure 3 illustrates a display system 30, which 
receives computer generated data. Once data in an 
appropriate format has been delivered to the display 
memory 24 of each system 20 and 30, the two systems 
are essentially the same. In Figures 2 and 3, only those 
components significant to main-screen pixel data 
processing are shown. Other components, such as 
might be used for synchronization or audio signals or 
secondary screen features, are not shown. 

In the example of this description, system 20 and 
system 30 approximate a two-fold increase in horizontal 
resolution. This calls for the use of two DMDs 25. How- 
ever, in general, an n-fold increase in resolution calls for 
n DMDs 25. Also, as explained below, the same principle 
may be used to enhance vertical resolution. 

For purposes of this description, the two DMDs 25 
each generate a "frame" of image data, where a frame 
has x pixels per row and y rows. This requires the DMD 
array to have a minimum of x mirror elements per row 
and y rows. Although the DMD array could be larger, for 
simplicity of explanation it will be assumed that the size 
of the DMD array corresponds to the size of the image. 

The following description briefly describes the over- 
all structure and operation of system 20. More compre- 
hensive descriptions of DMD-based display systems, 
without the enhanced resolution described herein, are 
set out in U.S. Patent No. 5,079,544, entitled "Standard 
Independent Digitized Video System", Published Euro- 
pean Patent Application No 0,651, 577 A2 (Atty Dkt No. 
TI-17855). and Published European Patent Application 
No. 0.663,770 A2 (Atty Dkt No. Tl- 17671). Each of these 
patents is assigned to Texas Instruments Incorporated. 

Signal interface unit 21 receives an analog video sig- 
nal and separates video, synchronization, and audio sig- 
nals. It delivers the video signal to A/D converter 22a and 
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Y/C separator 22b, which convert the data into pixel-data 
samples and which separate the luminance ("Y") data 
from the chrominance ("C") data, respectively. In Figure 
2, the signal is converted to digital data before Y/C sep- 
aration, but in other embodiments, Y/C separation could 
be performed before A/D conversion, using analog fil- 
ters. 

For a system 20 having two SLMs 25, the sample 
rate of A/D converter 22a provides samples for twice the 
number of pixels per row of the image generated by each 
SLM 25. In other words, where each of two SLMs 25 gen- 
erates an image with x pixels per row and y rows, the 
sample rate provides 2x samples per row. As explained 
below, the perceived image is comprised of two "sub- 
images", which are partially superposed. This perceived 
image has a quality that approximates the quality of an 
image with 2x pixels per row from a single SLM having 
2x pixel elements. More generally, for a perceived image 
quality that approximates that of a single SLM having n(x) 
pixel elements per row, the sample rate provides n(x) 
samples per row. 

Processor system 23 prepares the data for display 
by performing various pixel data processing tasks. Proc- 
essor system 23 includes whatever processing memory 
is useful for such tasks, such as field and line buffers. 
The tasks performed by processor system 23 may 
include linearization (to compensate for gamma correc- 
tion), colorspace conversion, and line generation. The 
order in which these tasks are performed may vary. 

Display memory 24 receives processed pixel data 
from processor system 23. It formats the data, on input 
or on output, into "bit-plane" format, and delivers the bit- 
planes to SLMs 25, one bit-plane at a time. The bit-plane 
format permits each mirror element 12 of SLMs 25 to be 
turned on or off in response to the value of one bit of data 
at a time. For samples of data having n bits per sample, 
there are n bit-planes per frame. 

In a typical display system 20, display memory 24 is 
a "double buffered" memory, which means that it has a 
capacity of at least two display frames of data. The buffer 
for one display frame can be read out to SLMs 25 while 
the buffer for another display frame is being written. The 
two buffers are controlled in a "ping-pong" manner so 
that data is continuously available to SLMs 25. 

Various techniques can be used to address SLMs 
25 to provide greyscale images. Published European 
Patent application No. 0,507,270A2 describes such 
techniques. This patent is assigned to Texas Instruments 
Incorporated. Some of the techniques discussed therein 
include clearing blocks of mirror elements 12, using extra 
"off" times to load data, and of breaking up the time in 
which more significant bits of data of each sample are 
displayed. These techniques can be applied to a system 
20 having multiple DMDs 25 in accordance with the 
invention. However, in general, addressing of SLMs 25 
is on a bit-plane basis, with all bit-planes for a frame 
being displayed during a frame period. For purposes of 
this invention, each of n number of SLMs 25 receives 
data representing every nth sample of a bit-plane. 



In accordance with example of this description, 
where system 20 has two DMDs 25, each DMD 25 
receives data representing every other sample (even or 
odd) of each row of the image. The allocation of data 
s between DMDs 25 is achieved by some sort of multiplex- 
ing operation, either on input to, or on output from, mem- 
ory 24. In Figure 2, a multiplexer 24a at the output of 
memory 24, performs this function. 

In the example of this description, each DMD 25 has 
10 square mirror elements 10 with a center-to-center hori- 
zontal spacing of a distance, D. Each DMD 25 is config- 
ured for a PAL format, which has 576 rows and an aspect 
ratio of 4:3. For square mirror elements, the PAL format 
calls for each DMD 25 to have an array that is at least 
15 768 mirror elements per row and at least 576 rows of 
mirror elements. A "frame" of image data is comprised 
of 576 rows of samples, each row having 768 samples. 

Display optics unit 26 has optical components for 
receiving the images from DMDs 25 and for focussing 
20 them to an image plane such as a display screen. For 
color displays, the bit-planes for each color could be 
sequenced and synchronized to a color wheel that is part 
of display optics unit 26. Master timing unit 27 provides 
various system control functions. 
25 Figure 4A illustrates the two partially superposed 
images generated by display system 20, which are simul- 
taneously projected to the image plane. Each DMD 25 
provides one of these "sub-images". One sub-image is 
comprised of even pixels from even data samples. The 
30 other sub-image is comprised of odd pixels from odd 
data samples. Thus, one image is an "even" pixel image, 
and the other an "odd" pixel image. These two images 
are horizontally displaced relative to each other by a dis- 
tance of 1/2 the center-to-center horizontal spacing of 
35 the mirror elements. Thus, in the example of this descrip- 
tion, the displacement is a distance of D/2. More gener- 
ally, for a system having n DMDs 25, the displacement 
of the sub-images are in increments of 1/n the center-to- 
center horizontal spacing between mirror elements 10. 
40 As another example, a system having three DMDs for 
approximately a three-fold increase in horizontal resolu- 
tion would have its sub-images offset so that the second 
is horizontally offset D/3 from the first, and the third is 
horizontally offset D/3 from the second. The perceived 
45 effect of displaying two partially superposed images in 
this manner is discussed below in connection with Fig- 
ures 5-8. 

Figure 4B illustrates an alternative embodiment of 
the invention, in which vertical resolution rather than hor- 

50 izontal resolution is enhanced. In the example of Figure 
4B, the image approximates a two-fold increase in verti- 
cal resolution, which calls for the use of two DMDs 25. 
Where each DMD 25 provides an image with y rows, 
processor system 23 is programmed to provide data for 

55 2(y) rows. Some sort of line doubling or interpolation can 
be used for this purpose. For a PAL format, the data has 
2(576) rows of data samples. Each DMD 25 receives 
data for alternating rows, and each DMD 25 provides a 
sub-image having 768 pixels per row and 576 rows. 
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Thus, one image is an "even" row image, and the other 
an "odd" row image. The two images are partially super- 
posed, with an offset in the vertical direction of D/2, or 
1/2 the center-to-center vertical spacing between pixel 
elements. 

The above-described principles could be combined 
to provide an image that enhances both horizontal and 
vertical resolution. In this case, two SLMs each receive 
data for alternating samples and alternating rows. Two 
sub-images would again be partially superposed, with a 
displacement of D/2 in the horizontal direction and D/2 
in the vertical direction. 

Perceived Resolution 

Figures 5 - 8 illustrate the quality of an output image 
generated in accordance with the invention. As 
explained below, a system like system 20, which has 2 
DMDs with partially superposed sub-images, is used to 
sample and display the image. 

Figure 5 is the frequency spectrum of an input 
image. For purposes of example, a one-dimensional 
image is assumed, but the same analysis applies to two- 
dimensional images. 

Figure 6 illustrates the frequency spectrum of the 
image of Figure 5 after sampling. In accordance with the 
invention, the image is sampled at a faster rate than 
would be used for generating an image from a single 
SLM 25. For example, where each of two SLMs 25 gen- 
erates an image having x pixels per row, the sample rate 
provides 2(x) samples per row. As indicated, this sample 
rate is sufficiently great so as to prevent aliasing. 

Figure 7 illustrates two modulation transfer functions 
(MTFs). The MTF illustrated by the solid line is that of 
system 20, whose pixels are square and of width, D, and 
whose images are partially superposed in accordance 
with the invention. The MTF illustrated by the dotted line 
is that of a DMD having twice as many mirror elements 
per row, with the width of the mirror elements reduced to 
D/2 so as to increase horizontal resolution without affect- 
ing the aspect ratio of the output image. 

Figure 8 illustrates the spectra of two output images, 
obtained by multiplying the sampled image spectrum of 
Figure 6 with each MTF of Figure 7. The output of system 
20 is shown in solid line, and the output of the DMD with 
twice as many pixel elements per row is shown in dotted 
line. The input image is shown in dashed line. The differ- 
ence in distortion between the two output images is min- 
imal, which indicates that the perceived resolution of 
system 20 approaches that of a system with twice as 
many pixels per row. 

Claims 

1 . A method of enhancing the resolution of a display 
system, the display system including two or more 
spatial light modulators (SLMs), which method com- 
prising: 

receiving sampled image data for each spa- 



tial light modulator; 

focussing radiant energy reflected from each 
spatial light modulator to form a sub-image on an 
image plane, each spatial light modulator generating 
5 the sub-image such that it is at least partically super- 
posed with an offset with respect to the sub-images 
of each other spatial light modulator; and 

simultaneously displaying the sub-images 
from each spatial light modulator. 

10 

2. The method of Claim 1 , further comprising receiving 
the sampled image data such that ever n th SLM 
receives data representing every n th sample. 

15 3. The method of Claim 1 -2 further comprising: 

focussing radiant energy reflected from each 
spatial light modulator onto the image plane such 
that the sub-image generated by one spatial light 
modulator is superposed with a horizontal offset with 

20 respect to the sub-images of each other spatial light 
modulator. 

4. The method of Claim 1 -2 further comprising: 

focussing radiant energy reflected from each 
25 spatial light modulator onto the image plane such 
that the sub-image generated by one spatial light 
modulator is superposed with a vertical offset with 
respect to the sub-images of each other spatial light 
modulator. 

30 

5. The method of Claim 1 -2 further comprising; 

focussing radiant energy reflected from each 
spatial light modulator onto the image plane such 
that the sub-image generated by one spatial light 
35 modulator is superposed with a horizontal and ver- 
tical offsets ith respect to the sub-images of each 
other spatial light modulator. 

6. A method of any preceding claim, wherein the 
40 focussing step is performed with a horizontal and/or 

vertical offset corresponding to 1/n of the centre-to- 
centre spacing of adjacent pixels of the spatial light 
modulators. 

45 7. The method of any preceding claim further compris- 
ing; 

performing the steps with two spatial light 
modulators such that an approximately two-fold 
increase in horizontal and/or vertical resolution is 
so achieved. 

8. A display system comprising; 

two or more spatial light modulators, each 
spatial light modulator being arranged to receive 
55 sampled image data; 

focussing means for focussing radiant energy 
reflected from each spatial light modulator to form a 
sub-image at an image plane, each spatial light 
modulator generating the sub-image such that it is 
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at least partially superposed with an offset with 
respect to the sub-images of each other spatial light 
modulator; and 

display means for simultaneously displaying 
the sub-images from each spatial light modulator. 5 

9. The display system of Claim 8, wherein the spatial 
light modulators are digital mirror devices (DMDs). 

1 0. The display system of claims 8-9, wherein pixels of 10 
the spatial light modulators are substantially square. 
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(54) Method of enhancing the resolution of a display system 



(57) A display system (20) that uses multiple SLMs 
(25) to enhance horizontal or vertical resolution, or both. 
For example, to approximate a two-told increase in hor- 
izontal resolution, the input data is sampled at a dou- 
bled rate, and each SLM (25) receives every other 
sample. Each SLM (25) generates an image, and the 



two images are partially superposed with a horizontal 
offset and simultaneously displayed. The resulting out- 
put image has a perceived resolution that approximates 
that of an image generated by an SLM with twice as 
many pixels per row. 
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